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1 Title of Invention 

A Method for Bi-Predictive Weighting using Single Constrained Wei 

ght 



ght comprising the steps of: 

obtaining the values of two motion compensated prediction blocks; 

determining the temporal distances of the reference pictures and 
the current picture; 

calculating the constrained weight and the shift denominator base 
d on said temporal distances; and 

calculating the values of the combined prediction block based on 
said weight and said shift denominator. 

2) The method for bi-predictive weighting using single constrained w 
eight according to claim 1, 

where said prediction blocks are the results of motion compensati 
on using each set of motion vectors. 

3) The method for bi-predictive weighting using single constrained w 
eight according to claim 1, 

where said temporal distance represents the position of a picture 
in time relative to a particular picture. 

4) The method for bi-predictive weighting using single constrained w 
eight according to claims 1 and 2, 



2 Claims 



1) 



A method for bi-predictive weighting using single constrained wei 
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where said reference picture for motion compensation can be selec 
ted from a list of reference pictures stored in the buffer. 



eight according to claims 1, 2 and 3, 

where said motion compensated prediction blocks can be predicted 
from the same reference picture. 



eight according to claims 1, where calculation of said constrained weigh 
t and said shift denominator comprising the steps of: 

calculating the weighting factor; 

calculating the shifting factor; 

calculating said shift denominator by subtracting seven with said 
shifting factor; and 

calculating said constrained weight by shifting said weighting fa 
ctor to the right by the shifting factor. 

7) The method for bi-predictive weighting using single constrained w 
eight according to claims 1 and 6, whereby the calculation of said weigh 
ting factor comprising the steps of: 

calculating the difference in said temporal distances between the 
current picture and the first reference picture; 

shifting said difference to the right by seven; 

calculating the difference in temporal distances between said fir 
st reference picture and the second reference picture; and 

obtaining a weighting factor by dividing said shifted value with 
second said difference in temporal distance. 



5) 



The method for bi-predictive weighting using single constrained w 



6) 



The method for bi-predictive weighting using single constrained w 
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8) The method for bi -predictive weighting using single constrained w 

eight according to claims 1, 6 and 7, whereby the calculation of said sh 

ifting factor comprising the steps of: 

finding the absolute value of said weighting factor; 
shifting said absolute value to the right by seven; and 
calculating said shifting factor by counting the bit position of 

the most significant bit from the right for the said shifted absolute va 

lue. 



9) The method for bi-predictive weighting using single constrained w 
eight according to claims 1, 6, 7 and 8, 

where said most significant bit is the first bit with the value 1 
from the left. 



10) The method for bi-predictive weighting using single constrained w 
eight according to claims 1, 6, 7 and 9, where said shifting factor can 
also determined using the steps of: 

adding one to said shifted absolute value; 
finding the base-2 logarithm of the new shifted value; and 
finding the nearest integer greater than or equal to the said bas 
e-2 logarithm value. 

11) The method for bi-predictive weighting using single constrained w 
eight according to claims 1, 5 and 6, 

where the first default values are used for said constrained weig 
ht and said shifting denominator if said two prediction blocks are motio 
n compensated from the same reference picture. 

12) The method for bi-predictive weighting using single constrained w 
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eight according to claims 1, 5, 6 and 11, 

where said first default values are used for said constrained wei 
ght and said shifting denominator if the reference picture for the secon 
d prediction block is not the first reference picture of the second list 

13) The method for bi-predict ive weighting using single constrained w 
eight according to claims 1, 5, 6, 11 and 12, 

where each prediction block of motion compensation has its own li 
st of reference picture indexes. 

14) The method for bi-predict ive weighting using single constrained w 
eight according to claims 1, 5, 6, 11 and 12, 

where said first defaults values for said constrained weight and 
said shifting denominator are one and one, respectively. 

15) The method for bi-predict ive weighting using single constrained w 
eight according to claims 1, 5 and 6, 

where said second default values are used for said constrained we 
ight and said shifting denominator if said shifting factor is greater th 
an seven. 

16) The method for bi-predict ive weighting using single constrained w 
eight according to claims 1, 5, 6 and 15, 

where said second default values for said constrained weight and 
said shifting denominator are one and zero, respectively. 

17) The method for bi-predict ive weighting using single constrained w 
eight according to claim 1, where calculating the values of the combined 
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prediction block comprising the steps of: 

subtracting the values of the second prediction block with the va 
lues of the first prediction block; 

multiplying said subtracted values with said constrained weight; 

adding said multiplied values with a shifting offset; 

shifting said results to the left by said shifting denominator; 

adding said shifted results with the values of said first predict 
ion block to obtain said values of the combined prediction block; and 

constraining said values of the combined prediction block to eigh 



18) The method for bi-predictive weighting using single constrained w 
eight according to claims 1 and 17, 

where said shifting offset is one shifted to the left by the said 
shifting denominator minus one. 

19) The method for bi-predictive weighting using single constrained w 
eight according to claims 1, 17 and 18, 

where said shifting offset is zero if the shifting denominator eq 
ual to zero. 

20) The method for bi-predictive weighting using single constrained w 
eight according to claims 1 and 17, where constraining said values compr 
ising the steps of: 

setting said values of the combined prediction block to two hundr 
ed and fifty five if said values are greater than two hundred and fifty 
five; and 

setting said values of the combined prediction block to zero if s 
aid values less than zero. 



t bits. 
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3 Detailed Description of Invention 

3.1 Industrial Field of Utilization 

This invention can be used in any advanced multimedia data coding 
, especially in IS0/IEC 14496-2 Part 10 standard, to improve the quality 
of bi-predictive coded pictures. This invention helps to improve the c 
oding efficiency of video sequences with fading effects. These fading e 
ffects are very common to be found in movie and music videos clips. 

3.2 Background and Prior Art 

Bi-predictive motion compensation in video compression technique 
is usually used to improve the compression ratio of the video. Two bloc 
ks of predictive samples are obtained using motion vectors and motion co 
mpensations on the previously decoded reference pictures. In convention 
al video coding techniques, these two motion compensated prediction bloc 
ks are averaged to obtain the final block of prediction samples. 

Some video compression techniques, for example like IS0/IEC 14496 
-2 Part 10 standard, allows certain weights to be applied to the two mot 
ion compensated blocks. The combined prediction block may have a strong 
er weight for one of the prediction block and a weaker weight on the oth 
er. Figure 1 shows an example of how the Bi-predictive weighting is per 
formed. For convectional Bi-predictive coding, a and b values are and 
, respectively. However for sequences with fading effects, a differen 
t values of a and b would result in a better compression. 

Figure 2 shows the prior art in determining the bi-predictive wei 
ghts based on the temporal distance for the interpolation case. As show 
n in Figure 2, the weights WO and Wl are derived from the equations (1) 
and (2). 
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WO = (128*(T1-T)) / (Tl-TO) 
Wl = (128*(T1-T)) / (Tl-TO) 



(1) 
(2) 



Where T, TO and Tl represent the temporal representations of the 
current picture, the reference picture for prediction block 1 and the re 
ference picture for prediction block 2, respectively. 

The values of combined prediction block can be derived from the w 
eights based on the equation (3). 

P = (P0*W0+Pl*Wl+64) »7 (3) 

Where PO and PI represent the pixel values of the prediction bloc 
ks 1 and 2, respectively. Similar to the Figure 2, the weights for the 
extrapolation case in figure 3 can be calculated based on equation (1) a 
nd (2). However in the extrapolation case, one of the weights will be g 
reater than 128. 

The prior art requires division operations to determine the weigh 
ts. To speed up the computation process of the combined prediction bloc 
k, the weights are usually pre-calculated at the start of every picture 
to save computation time. These weights are stored in a table and retri 
eved at the block level based on reference picture indexes. For video c 
ompression techniques like ISO/IEC 14496-2 Part 10 standard that support 
multiple reference pictures for prediction, the size of this two-dimens 
ional look-up table depends on number of reference pictures that can be 
used for picture. Hie number of entries in this table is the square of 
the number of reference pictures available for prediction as shown in eq 
uation (4). 



N = Nref x Nref 



(4) 
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Where N is the number of entries in the look-up table and Nref is 
the number of reference pictures available for prediction. Each entry 
in the table will contain WO and Wl values. 

Video compression techniques like IS0/IEC 14496-2 Part 10 standar 
d also allows the two prediction blocks P0 and PI to be from the same re 
ference picture. Thus in this case, the temporal distance Tl TO will b 
e zero. To prevent the division by zero, both weights, WO and Wl, will 
be defined as 128 and 128, respectively. 

Figure 4 shows the block diagram illustrating the prior art in ca 
lculating the prediction block P. Firstly, the values of P0, PI, T, Tl 
and TO are obtained in module 401. The values of Tl and TO will then be 
compared to see if they are the same in module 402. If the two values 
are the same, both the values of W0 and Wl will be set to 128 as shown i 
n module 404. On the other hand, if these two values are different, W0 
and Wl will be calculated based on equations (l) and (2), respectively a 
s shown in module 404. Hie values of the combined prediction block P wi 
11 then be calculated based on the values W0, Wl, P0 and PI using equati 
on (3) as shown in module 405. 

3.3 Problem to be Solved 

The prior art for Bi-Predictive weighting requires pre-ca leu latin 
g the weights in order to avoid the division operation when obtaining th 
e prediction samples. The number of weights to calculate will depends o 
n the number of reference pictures available. So for the worst case, th 
e number of weights that are required to calculate is one thousand and e 
ight hundred if there are thirty different reference pictures available. 

This would mean one thousand and eight hundred division operations per 
picture for the worst case. 
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Beside this, the intermediate operations required to obtain the p 
rediction values of the Bi-Predictive weighting will exceed 16 bits. Th 
is is because in the extrapolation case, one of the weights will be grea 
ter than 128 and the multiplication in equation (3) will result in a sig 
ned value greater than 16 bits. Thus these operations need to be perfor 
med in 32-bits boundary in order for the values not to overflow. This w 
ould mean a longer processing time to perform the Bi-Predictive Weight in 
g for processors capable of performing parallel operations in 16 bits 

3.4 Means of Solving the Problem 

To solve the problem, a new method of Bi-Predictive Weighting usi 
ng single constrained weight is introduced. The new method can be imple 
mented using 16 bits operations and the number of weights to pre-calcula 
te is much lesser than the prior art. 

Currently, the algorithm to perform the Bi-Predictive Weighting i 
n the prior art is not efficient to be implemented in parallel operation 
s and it requires two weights to be pre-calculated for every combination 
of the reference picture of the first direction and the reference pictu 
re of the second direction. What is novel about this invention is that 
this invention only requires one weight to be calculated for each combin 
at ion of the reference pictures and number of weights to be calculated i 
s constrained to the number of reference pictures. Thus the number of d 
ivision operations is greatly reduced. 

3.5 Operation of the Invention 

The operation of the invention is described hereafter. This inve 
ntion can be applied after obtaining two blocks of prediction samples us 
ing bi-predictive motion compensation. This invention is applied to mer 
ge the two blocks of prediction samples to form single block of predicti 



ffiSE4# 2003-3083629 



m 



2002-336294 



^-v: 10/ 



on samples to be used 'for reconstructing the pixel values of the picture 

3. 6 Embodiments 

The current invention can be used to perform bi-predictive weight 
ing with lesser complexity as compared to prior art. Instead using two 
weights, the current invention uses only one weight to perform the bi-pr 
edict ive weighting. Equation (5) shows the new equation for determining 
the values of the combined prediction block based on Wl, P0 and PI. 

P = P0 + ((P1-P0)*BWD)»LWD (5) 

As shown in equation (5), only BWD and LWD need to be calculated. 
The weight BWD is determined based on equations (6), (7) and (8). 

BWDO = ((T-T0)<<7)/(T1-T0) (6) 

LWDO = Ceil(log2(l+(abs(BWD0)»7)) (7) 

Where the function Ceil( x ) rounds x up to the nearest integer g 
reater than or equal to x. The function log2(x) returns the base-2 loga 
rithm of x and the function abs(x) returns the absolute value of x. 

BWD = BWDO » LWDO (8) 

The shift parameter LWD in equation (5) is calculated using equat 
ions (6), (7) and (9). 

LWD = 7- LWDO (9) 



ffitE3#2 003-3083629 



• 



2002-336294 



^-v: 11/ 



LWDO in equation (7) also means the number of bits to represent t 
he integer value of abs(BWD0)»7. 

The current invention can be implemented using 16 bits with the h 
elp of equation (8). Equation (8) will constrain the weight such that t 
he intermediate multiply operation in equation (5) will not exceed 16 bi 
ts. Thus the bi-predictive weighting can be easily implemented in paral 
lei operations using 16 bits operations. To reduce the computations, th 
e values of BWD and LWD can be pre-calculated and stored in a look-up ta 
ble at the start of the picture or slice. 

Besides this, a new constraint is applied in the current invent io 
n to reduce the number of calculations needed to pre-calculate the weigh 
ts at picture or slice basis. The constraint is that if the reference p 
icture for the prediction block PI or the temporal representation of pre 
diction block PI, Tl, does not belong to the first reference picture of 
the second list (list 1), a default weight will be used. For IS0/IEC 14 
496-2 Part 10 standard, the first reference picture of the second list i 
s the reference picture with index 0 of list 1. The default weight will 
be BWD equal to 1 and LWD equal to 1. Similarly if the LWDO is calcula 
ted to be greater than 7, another default weight will be selected. This 
weight shall be BWD equal 1 and LWD equal to 0. 

Figure 5 shows the current invention in determining the values of 
the prediction block using bi-predictive weighting. The values of P0, 
PI, T, TO and Tl are obtained in module 501. Firstly, the first check i 
s applied to see if the reference picture for the prediction block PI is 
the first reference picture in the list (i.e. index 0 of list 1) as sho 
wn in module 502. If the condition is false, in another words the refer 
ence picture used for prediction for PI is not the first reference pictu 
re in the list, the first default weight will be used as shown in module 
504. The first default weight has the values of BWD equal to 1 and LWD 
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equal to 1. If the condition in module 502 is true, a second check is 
applied to see if the values of Tl and TO are the same as shown in modul 
e 503. If the values are the same, the first default value will be appl 
ied in module 504. On the other hand, if the values of Tl and TO are no 
t the same, the values of BWD0 and LWD0 will be calculated in module 505 

using equations (6) and (7), respectively. 

In module 506, the value of LWD0 is then checked to see if it is 
greater than seven. If it is greater than seven, the second default wei 
ght will be applied in module 507. The second default weight has the va 
lues of BWD equal to 1 and LWD equal to 0. If the value of LWD0 is less 

than seven, the values of BWD and LWD will be calculated in module 508 
based on the equations (8) and (9), respectively. Lastly, the values of 

the combined prediction block P are calculated based on the determined 
values of BWD and LWD using equation (5) in module 509. 

With the constraint introduced by the current invention, the numb 
er of calculations and the size required to construct the look-up table 
of weights is much smaller as compared to prior art. The number of divi 
sions required is equal to the number of reference pictures available mi 
nus one. The reason is because the rest of the entries in the look-up t 
able are using the default weights. Thus only a small portion of the we 
ights is required to be calculated. 

3.7 Effects of Invention 

The effect of the present invention is to effectively perform the 
bi-predictive weighting of two motion-compensated blocks. The effect i 
s evident in the form of lesser computations in obtaining the values of 
the bi-predictive weighted block at both the encoder and decoder. 

4 Brief Description of Drawings 
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Figure 1 Shows the concept of bi-predictive weighting of two 
prediction blocks. 

Figure 2 Shows an example of the prior art in determining th 
e bi-predictive weights for the interpolation case using temporal distan 
ce. 

Figure 3 Shows an example of the prior art in determining th 
e bi-predictive weights for the extrapolation case using temporal distan 
ce. 

Figure 4 Shows the prior art in the process to calculate the 
values of the prediction block using bi-predictive weighting. 

Figure 5 Shows the current invention in the process to calcu 
late the values of the prediction block using bi-predictive weighting. 
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1 Abstract 

The video compression technique described in the final committee 
draft of IS0/IEC 14496-2 Part 10 standard allows weighting to be perform 
ed on bi-predictive blocks to improve coding efficiency of fading sequen 
ces. An algorithm is used in the current final committee draft of ISO/I 
EC 14492-2 Part 10 to calculate the weights needed for bi-predictive wei 
ghting and to calculate the values of combined prediction block based on 
the weights and the two motion-compensated blocks. However this algori 
thm is not efficient in the sense that it cannot be implemented using 16 
bits operations and the number of computations required to determine th 
e weights in quite large for the worst case. For example, if the number 
of reference pictures is thirty, the number of weights that needs to be 
calculated is one thousand and eight hundred. The current invention in 
this document handles this by introducing a constraint on the number of 
weights that needs to be calculated and thus most of the weights will b 
e using default weights. A new algorithm is also introduced in this doc 
ument to perform a constrained bi-predictive weighting using a single we 
ight in the calculation and thus the intermediate operations of this new 
algorithm will not exceed 16 bits. The effect of the current invention 
is a reduction in complexity in performing bi-predictive weighting. 

2 Representative Drawing 



Figure 5 
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